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Abstract 

It is well known that the rock-paper-scissors game has no pure saddle point. We 
show that this holds more generally: A symmetric two-player zero-sum game has 
a pure saddle point if and only if it is not a generalized rock-paper-scissors game. 
Moreover, we show that every finite symmetric quasiconcave two-player zero-sum 
game has a pure saddle point. Further sufficient conditions for existence are pro- 
vided. We apply our theory to a rich collection of examples by noting that the 
class of symmetric two-player zero-sum games coincides with the class of relative 
payoff games associated with symmetric two-player games. This allows us to derive 
results on the existence of a finite population evolutionary stable strategies. 

Keywords: Symmetric two-player games, zero-sum games, Rock-Paper-Scissors, 
single-peakedness, quasiconcavity, finite population evolutionary stable strategy, 
increasing differences, decreasing differences, potentials, additive separability. 

JEL-Classifications: C72, C73. 



*Some of the material has previously been part of the paper "Unbeatable imitation" presented at the 
International Conference on Game Theory in Stony Brook, 2009. 

T Department of Economics, University of Heidelberg 

^Department of Economics, University of Heidelberg, Email: oechssler@uni-hd.de 
^Department of Economics, University of California, Davis, Email: bcschipper@ucdavis.edu 



1 Introduction 



Many zero-sum games do not have a solution without allowing for mixed actions. What 
is the class of zero-sum games possessing pure saddle points? Some answers to these 
questions have been given by Shapley (1964) and Radzik (1991). For instance, Shapley 
(1964) showed that a finite two-player zero-sum game has a pure saddle point if every 2x2 
submatrix of the game has a pure saddle point. Radzik (1991) provided conditions using 
a discrete notion of quasiconcavity/quasiconvexity. He showed for instance that a two- 
player zero-sum game whose columns are quasiconcave (i.e. single-peaked) and whose 
rows are quasiconvex has a pure saddle point if and only if every submatrix "along the 
diagonal" has a pure saddle point. Although both Shapley's and Radzik's results apply 
to symmetric two-player zero-sum games, none of their results exploits the symmetry 
property. 

In this paper we are interested in pure saddle points of symmetric two-player zero- 
sum games. It is well known that for instance the rock-paper-scissors game has no pure 
saddle point. We show that this holds more generally. We say that a symmetric two- 
player game is a generalized rock-paper-scissors game if for each column there exists a row 
with a strictly positive payoff. This notion allows us to characterize symmetric zero-sum 
games possessing pure saddle points. A symmetric two-player zero-sum game has a pure 
saddle point if and only if it is not a generalized rock-paper-scissors game. Moreover, 
we show that every finite symmetric quasiconcave two-player zero-sum game has a pure 
saddle point. We also provide alternative sufficient conditions for existence in terms 
of increasing and decreasing differences, potentials and additive separability of payoffs. 
It turns out that a symmetric two-player zero-sum game has increasing differences if 
and only if it has decreasing differences. This implies that the payoff function is a 
valuation. By Topkis (1998) this is equivalent to additively separable payoffs and by 
Branzei, Mallozzi, and Tijs (2003) it is equivalent to being an exact potential game a la 
Monderer and Shapley (1996). 

We apply our theory to a rich class of examples. Zero-sum games arise naturally when 
relative payoffs of arbitrary two-player games are considered]]] The class of symmetric 
two-player zero-sum games coincides with the class of relative payoff games associated 
with symmetric two-player games. Pure saddle point actions of relative payoff games 

1 There is some experimental evidence that players consider not only their absolute payoffs but also 
relative payoffs. Early experiments include Nydegger and Owen (1974) and Roth and Malouf (1979). 
More recently, relative payoff concerns have been studied in behavioral economics and experimental 
economics under the label of "inequity aversion" . 
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characterize finite population evolutionary stable strategies in the underlying game. We 
apply our result to show the existence of finite evolutionary stable strategy in Cournot 
duopoly, Bertrand duopoly, public goods games, common pool resource games, minimum 
effort coordination games, synergistic relationships, arms race, Diamond's search, Nash 
demand game, rent seeking etc. 

The notion of finite population evolutionary stable strategy (fESS) has been intro- 
duced by Schaffer (f 988, 1989). He also noted the relationship between pure saddle points 
in relative payoff games and finite population evolutionary stable strategy of the under- 
lying game. This relationship between Nash equilibrium and fESS equilibrium has been 
analyzed for competitive games by Ania (2008) and for "weakly competitive" games 
by Hehenkamp, Possajennikov, and Guse (2010). Versions of fESS have been applied 
to learning and evolution in Aids- Ferrer and Ania (2005), Hehenkamp, Leininger, and 
Possajennikov (2004), Leininger (2006), Matros, Temzilidis, and Duffy (2009), Possajen- 
nikov (2003), Schipper (2003), Tanaka (2000), and Vega-Redondo (1997). Our results 
developed here are used in a companion paper, Duersch, Oechssler, and Schipper (2010). 
There we characterize the class of games in which the decision rule "imitate-the-best" is 
not subject to a money pump by any other decision rule. 

In the next section we study the existence of pure saddle points in symmetric two- 
player zero-sum games. In Section 3 we apply our results to relative payoff games and 
the existence of finite population evolutionary stable strategies. 

2 Existence in Symmetric Zero-Sum Games 

A two-player zero-sum game (X 1 , X 2 , tti, 7r 2 ) consists of two players, player 1 and player 
2, and for each player i e {1,2} a set of pure actions Xi and a payoff function 7Tj : 
X% x X2 — > M such that tti = tx and 112 = — n. A two-player zero- sum game is symmetric 
if X\ = X2 = X and n(x,y) = —ir(y,x) for x, y G X. That is, the payoff matrices of 
symmetric zero-sum games are skew-symmetric j^] We write (A, ir) for a symmetric two- 
player zero-sum game. Note that in a symmetric zero-sum game, the payoffs on the main 
"diagonal" must be zero. 

Definition 1 In a symmetric two-player zero-sum game (X,tc), a pair of actions (x,y) 
is a pure saddle point if n(x,y) = max I / e j ( tt(x', y) = mm y ' e x y')- A pure saddle 
point (x,y) is symmetric if x = y. 

2 A square matrix M is skew-symmetric if M — —M T . 
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The following observation is well known. 

Remark 1 A symmetric two-player zero-sum game (X, n) has a pure saddle point if and 
only if it has a symmetric pure saddle point. 

Proof. "=>■": In a symmetric game, if (x",x') is a pure saddle point, so is (x',x"). By 
the interchangeability of saddle points in two-player zero-sum games, we have that also 
(x",x") and (x',x') are pure saddle points. The converse is straight-forward. □ 

Note that if a two-player symmetric zero-sum game has a saddle point, then the 
saddle-point payoff called the value of the game must be zero (von Neumann, 1928, p. 
306). Note further, that given a pure saddle point if an action is replaced by another 
action yielding the same payoff, then the latter is a saddle point action as well. That 
is, the game is strongly solvable in the sense of Nash (1951, p. 290-291). Such a strong 
solution exists only if there is a saddle point in pure actions. This makes pure saddle 
points very attractive. 

It is well known that the symmetric zero-sum game "Rock-Paper-Scissors" below has 
no pure saddle point. 
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We can generalize the Rock-Paper-Scissors game. 

Definition 2 (Generalized Rock-Paper-Scissors Matrix) A finite symmetric zero- 
sum game (X, tt) is a generalized rock-paper-scissors matrix if in each column there exists 
a row with a strictly positive payoff to player 1 (i.e., the row player). 

This definition allows us to provide a full characterization of pure saddle points in 
finite symmetric two-player zero-sum games. 

Theorem 1 A finite symmetric two-player zero-sum game (X, it) possesses a pure saddle 
point if and only if it is not a generalized rock-paper-scissors matrix. 

Proof. u <=": We show the contrapositive, i.e., if there does not exist a pure saddle 
point of the symmetric two-player zero-sum game (X, 7r), then (X, 7r) is a generalized 
rock-paper-scissors matrix. By Remark [TJ a symmetric zero-sum game has a pure saddle 
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point if and only if it has a symmetric pure saddle point, i.e., if and only if a a combination 
of actions on the main diagonal is a saddle point. Because (X, tc) is a symmetric zero-sum 
game, the payoffs on the diagonal must be zero. Thus, if a symmetric pure saddle point 
fails to exist, then for each column there must be a row for which the payoff is strictly 
positive to player 1. This implies that (X, it) is a generalized rock-paper-scissors matrix. 

"=>": Again, we show the contrapositive, i.e., if (X, tt) is a generalized rock-paper- 
scissors matrix, then there does not exist a pure saddle point. If (X, tc) is a generalized 
rock-paper-scissors matrix, then for each y G X (i.e., each "column") there exists x E X 
(i.e., a "row") for which the payoff of player 1 is strictly positive. Because (X, it) is a 
symmetric two-player zero-sum game, the payoff on the diagonal must be zero. Hence y 
is not a best response to y, and (y, y) is not a saddle point. Thus for any y G X, (y,y) 
is not a pure saddle point. □ 

Note that a symmetric 2x2 zero-sum game cannot be a generalized rock-paper-scissors 
game. If one of the row player's off-diagonal relative payoffs is a > 0, then the other 
must be —a violating the definition of generalized rock-paper-scissors matrix. "Matching 
pennies" is not a counter-example because it is not symmetric. Thus we have the following 
corollary: 

Corollary 1 Every symmetric 2x2 zero-sum game possesses a pure saddle point. 

Theorem [T] provides a characterization with a condition that is easy to check. Never- 
theless, it may be useful to know whether "standard" second-order conditions imply the 
existence of pure saddle points as well. 

One "standard" second-order condition is quasiconcavity. It is known that pure strat- 
egy Nash equilibria exist if X is a convex and compact subset of the Euclidean space 
and 7r is continuous (see Debreu, 1952). Yet, this does not imply the existence in finite 
games because they are not convex. We follow Radzik (1991) in defining the "discrete" 
analogon of quasiconcavity. It is the notion of single-peakedness. 

Definition 3 (Quasiconcave) A finite symmetric two-player zero-sum game (X, it) 
with the symmetric m x m payoff' matrix n = (n xy ) is quasiconcave (or single-peaked) if 
for each y G X , there exists a k y such that 

Kly < 7T 2y < . . . < 7T kyy > -Kky + ly > ■ ■■> ^my 
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That is, a symmetric zero-sum game is quasiconcave if each column has a single peak. 
This definition naturally extends the definition of quasiconcave payoff functions on convex 
real- valued spaces to the case of finite symmetric two-player zero-sum games. 



Theorem 2 Every finite quasiconcave symmetric two-player zero-sum game has a pure 
saddle point. 

Proof. Let (X, n) be a finite quasiconcave symmetric two-player zero-sum game. Since 
(X, 7r) is finite, there exists an enumeration of actions from 1 to m. For the proof, we 
proceed by induction on the set of actions. 

Recall that a combination of actions (k, £) is a pure saddle point of (X, it) if is 
the largest element in column i and the smallest element in row k. 

For m = 1 the claim is trivial. 

Now let m > 1 and assume that there exists a pure saddle point of the symmetric 
upper block payoff matrix (n r ^) rtC < n<m . We will show that there exists also a pure saddle 
point of the symmetric upper block payoff matrix (7r r c ) r . c < n+1 < m . 

Since (7r r c ) r . c < n<m has a pure saddle point, by Remark [I] it has a symmetric pure 
saddle point. Let (k, k) be the largest symmetric pure saddle point (with respect to the 
enumeration of X) of ij r ,c)r,c<n<m- 

Case A {ix n +\,k < 70^): We claim that if n n +i,k < ^k,k then (k, k) is a symmetric 
pure saddle point of {^ r ,c)r,c<n+i<rn- To see this, note that since (X, n) is a symmetric 
two-player zero-sum game, we must have 7r& & — 0, and 71% ^ < 7ik,n+i- Hence, 71% £ remains 
a largest element in column k and a smallest element in row k after adjoining row n + 1 
and column n + 1 to {^ r ,c)r,c<n< m - Thus (k, k) is a symmetric pure saddle point of 

(tI V ,c) r ,c<n+l<m' 

Case B (^+1^ > 7r njri and n = k): Next we claim that if n = k (i.e., (n,n) is the 
largest symmetric pure saddle point of (7i r ,c)r,c<n<m) with respect to the enumeration of 
actions and n n+1 >n > 7T n>n , then (n+ 1, n + 1) is a pure saddle point of {jt r ,c)r,c<n+i<m- To 
see this consider the payoff matrix given in Equation (FT]): 
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We prove all inequalities numbered in the matrix in sequel: 



1. Since 7r n+1 n > 7r n ri and the fact that (X, tt) is a symmetric two-player zero-sum 
game, it follows that ir n>n > ir njTl+ i. 

2. Since 7r„ in = 7r n+ i, n+ i = and 7r„ >n > ir n ,n+i, by (1.), we must have ir n ^ +1 < 

7Tn+l,n+l- 

3. From (2.) and quasiconcavity follows that 7r n n+1 > 7r r n+1 for r < n. 

4. From (2.) and the fact that (X,ir) is a symmetric two-player zero-sum game, it 
follows that ir n+1)n > n n+hn+1 . 

5. From (3.) and the fact that (X,tt) is a symmetric two-player zero-sum game, it 
follows that vr n+ i jC > 7r n +i )fl for c < n. 

Hence 7r n+1 „ +1 is the largest element in column n + 1 and the smallest element in row 
n + 1. Thus (n + 1, n + 1) is a symmetric pure saddle point. 

Case C (iTn+iyk > n k,k and k < n): Finally, we analyze the case k < n and n n +i,k > 
T^k,k- Consider the payoff matrix given in Equation ([2]): 

/ : : 



7T 



(2.) (2.) 
7Tfc,fc — ^k,k+l — 

nil.) 



A , (4.) 

(3.) 



I 



1.(1.) 

A 



(5.) 



TT,, 



(2) 



-l,n+l / 



1. We must have 7r ri fc = 7Tfc 5 fc for n + 1 > r > k. To see this, note that if tt^ < 7Tk,k, 
then we have a contradiction to quasiconcavity. If ir r ^ > ir^ki then we have a 
contradiction to (k, k) being a pure saddle point. 

2. From (1.) and the fact that (X, tt) is a symmetric two-player zero-sum game follow 
that TTk^k = TTk,c for n + 1 > c > k. 

3. 7Tfc,n > ^k,n+i follows from the assumption n n+ i^ > ^k,k and the fact that (X, tt) is 
a symmetric two-player zero-sum game. 
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4. Note that by (3.) TTk, n +i < 0. Since 7r n+ i in+ i = 0, it follows from quasiconcavity 

that Ttk,n+1 > 7Tr,n+l for > r > 1. 

5. From (4.) and the fact that (X, tt) is a symmetric two-player zero-sum game follow 
that 7r n+1;C > 7r„ +1;fc for c < k. 

Since (A; + 1, k + 1) is not a saddle point (because (k, k) is the largest symmetric 
saddle point with respect to the enumeration of actions by assumption), there must exist 
a column c such that 7r fc+ljC < 7r fc+l fc+1 with either 

(i) c < k + 1, or 

(ii) n + l>c>& + l. 

Consider first case (i). Note that by (5.) in Equation ^ we must have that 
^n+i.c > ^k+i,c- Yet, we also have 7r CjC = > 7r fc+l c . These two inequalities contra- 
dict quasiconcavity. 

Consider now case (ii). Note that by (3.) in Equation ^ we must have that 7Tfc jC = 
> 7Tfc+i jC . Yet, we also have ir CiC = > Hk+\,c- These two inequalities contradict 
quasiconcavity. 

Thus, Case C leads to a contradiction. 

Since Cases A, B and C exhaust all cases, we finished the induction step. This com- 
pletes the proof of the proposition. □ 

Note that if the finite zero-sum game is not symmetric but quasiconcave, then it does 
not need to have a pure saddle point. A counter example is presented in Radzik (1991, 
p. 26). Hence, symmetry is crucial for the result. 

In Example [T] below we will show that Theorem [T] is strictly more general than The- 
orem [2] That is, there are games that are not quasiconcave and not generalized rock- 
paper-scissors games. 

Other "second-order" conditions are commonly explored in the literature when ana- 
lyzing the existence of pure equilibria. We will consider strategic complementarities and 
substitutes, additive separability, and potentials. Surprising to us, it turns out that for 
symmetric two-player zero-sum games these conditions are all equivalent. 

Definition 4 (Strategic complementarities and substitutes) LetX be a totally or- 
dered set. A payoff function ir has decreasing (resp. increasing) differences on X x X if 
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for all x", x', y", y' G X with x" > x' and y" > y' , 



n(x\y")-n(x' : y") < (>)tt(x", y') - tt(x' : y'). 



ir is a valuation if it has both decreasing and increasing differences. 

Definition 5 ( Additively Separable) We say that a payoff function n is additively 
separable if n(x, y) = f(x) + g(y) for some functions f,g:X — > R. 

Potential functions are often useful for obtaining results on convergence of learning 
algorithms to equilibrium, existence of pure equilibrium, and equilibrium selection. The 
following notion of potential games was introduced by Monderer and Shapley (1996). 

Definition 6 (Exact potential games) The symmetric two-player game (X, ir) is an 
exact potential game if there exists an exact potential function P : X x X — > K. such 
that for all y G X and all x, x' G X , 



Lemma 1 Let (X, ir) be an arbitrary symmetric two-player zero-sum game. Then the 
following statements are equivalent: 

(i) There exists a total order on X and n has decreasing differences on X x X , 

(ii) there exists a total order on X and ir has increasing differences on X x X , 

(Hi) there exists a total order on X and n is a valuation, 

(iv) 7r is additively separable, 

(v) (X, 7r) has an exact potential. 

Proof. Let X be a totally ordered set such that n has decreasing differences on X x X 
if for all x'", x" ', x', x G X with x'" > x' and x" > x, 



Since (X, n) is a symmetric two-player zero-sum game, tt(x', x) = —n(x, x') for all x, x' G 
X. Hence, we can rewrite this inequality as 



n(x,y) - n(x',y) 
n(x,y) - n(x',y) 



P{x ) y)-P{x' ) y) ) 
P(y,x)-P(y,x'). 



n(x'",x")-ntf,x") < n(x'",x)-n(x',x). 



Tr(x",x"') + n(x",x') < -ir(x, x" 1 ) + n{x, x'). 



(3) 
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Rearranging inequality (J3J) yields the definition of increasing differences, 

TT\X , X ) — TT{X, X ) < TT[X ,X ) — TT{X, X ). 

Hence (i) if and only if (ii). (iii) follows from the equivalence of (i) and (ii). 

By Topkis (1998, Theorem 2.6.4.), a function tt(x, y) is additively separable on X x X 
if and only if n(x,y) it is a valuation. Thus, (iii) if and only if (iv). 

Branzei, Mallozzi and Tijs (2003, Theorem 1) show that a zero-sum game is an exact 
potential game if and only if it is additively separable. Hence, (iv) if and only if (v). □ 

Proposition 1 Let (X, tt) be a symmetric two-player zero-sum game for which X is 
compact and tt is upper semicontinuous. 

(i) If X is totally ordered and tt has decreasing differences on X x X , or 

(ii) if X is totally ordered and tt has increasing differences on X x X , or 

(iii) if X is totally ordered and tt is a valuation, or 

(iv) if tt is additively separable, or 

(v) if (X, 7r) is an exact potential game, 

then a pure saddle point exists. Moreover, for each player, the pure saddle point action 
is optimal against any of the opponent's actions. 

Proof. Since X is compact and tt is upper semicontinuous, any player's best reply 
correspondence of {X,tt) is nonempty by Weierstrass' Theorem. Since tt is additively 
separable under any property (i) to (v) by Lemma [TJ the best reply correspondence is 
constant. Thus, a pure saddle point of {X,tt) exists. □ 

For the remainder of this section, we consider the relationships between the results. 
Proposition [T] is implied by Theorem [2] if finite games are considered. 

Remark 2 Let (X, tt) be a finite symmetric two-player zero-sum game. 

(i) If X is totally ordered and tt has decreasing differences on X x X , or 

(ii) if X is totally ordered and tt has increasing differences on X x X , or 
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(Hi) if X is totally ordered and it is a valuation, or 

(iv) if 7r is additively separable, or 

(v) if(X,ir) is an exact potential game, 

then (X, 7r) is quasiconcave. 



Proof. By Lemma [TJ property (iv) holds if and only if any of the other properties 
hold. If property (iv) holds then there are some functions f,g:X — > R such that 
7i(x,y) = f\x) + g(y) for all x,y G X. Since X is finite, by standard utility theory there 
exists a complete, reflexive, and transitive binary relation > on X such that x' > x if 
and only if f(x') > f{x). Thus we can order X with respect to >. Note that this order is 
independent of y. Moreover, note that with X ordered by >, the game is quasiconcave. □ 



Example 12 in Section 3J3 shows that Theorem [2] is not implied by Proposition [TJ 
That is, there are symmetric two-player zero-sum games that are quasiconcave but whose 
payoff function is not additively separable, a valuation, an exact potential, nor possesses 
increasing or decreasing differences. 

Theorem [2] and Proposition [TJ overlap in the important case of 2x2 games. It is 
straight-forward to check the following observation: 



Remark 3 Every symmetric 2x2 zero-sum game is quasiconcave, additively separable, a 
valuation, has increasing and decreasing differences, and has an exact potential. 

The following example demonstrates that Theorem [TJ is a strict generalization of 
Theorem [2j 



Example 1 Consider the following "Rock-Paper-Scissors" game augmented by an addi- 
tional action "B". 
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Clearly, it is not a generalized rock-paper- scissors game since for column "B " there fails 
to exist a row yielding a strictly positive payoff. Thus, the game possesses a pure saddle 
point, (B,B). Yet, no matter how actions are ordered, the game fails to be quasiconcave. 
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Hence, there are symmetric two-player zero-sum games that are neither generalized rock- 
paper-scissors games nor quasiconcave. 



Figure [T] illustrates the relationships between various classes of games. The numbers 
refer to the examples. 
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Figure 1: Relationships among Classes of Finite Two-Player Symmetric Zero-Sum Games 



3 Applications to Relative Payoff Games 
3.1 Relative Payoff Games 

Consider now more generally the class of symmetric two-player (not necessarily zero- 
sum) games (X, it) with a (finite or infinite) set of pure actions X and a symmetric and 
bounded payoff function 7r : X x X — > R. We denote by ir(x, y) the payoff to the player 
choosing the first argument. We do not restrict ourselves to zero-sum games. 

When instead of the payoff function ir the relative payoffs are considered, then sym- 
metric two-player games give naturally rise to the class of symmetric zero-sum games. 

Definition 7 (Relative payoff game) Given a symmetric two-player game (X,ir), the 
associated relative payoff game is (X, A), where the relative payoff function A : XxX — > 
M. is defined by 



The relative payoff of a player is the difference between his payoff and the payoff of his 
opponent. 



A(x,y) 



ir(x,y) - ir(y,x). 
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Remark 4 Every relative payoff game is a symmetric zero-sum game. Conversely, for 
every symmetric zero-sum game, there is a symmetric two-player game for which the 
relative payoff game is the symmetric zero-sum game. 

Proof. Note that by definition, A(x,y) = —A(y,x) and hence (X, A) is a symmetric 
zero-sum game. For the converse, if (X, A) is a symmetric zero-sum game, then (X, \ A) 
is a symmetric two-player game for which (X, A) is the relative payoff game. To see 
this, note that since (X, A) is a symmetric zero-sum game, we must have that (X, \ A) 
is a symmetric zero-sum game. Note further that A(x,y) = ^A(x,y) — ^A(y,x) = 
\A(x, y) + \A(x, y), where the last equality follows from the fact that (X, |A) is a sym- 
metric zero-sum game. □ 

The remark shows that every relative payoff game is a symmetric zero-sum game, 
and that relative payoff games do not impose any restriction on the class of symmetric 
zero-sum games. Every symmetric zero-sum game is a relative payoff game of some 
symmetric two-player game. Note also that different symmetric two-player games may 
have the same relative payoff game. 

There is, however, an important conceptual difference between relative payoff games 
and zero-sum games in general. In relative payoff games, players are assumed by definition 
to make interpersonal comparisons. No such an assumption is made for general zero-sum 
games. 

3.2 Finite Population Evolutionary Stable Strategy 

What outcomes in a symmetric two-player game correspond to pure saddle points in 
its associated relative payoff game? To answer this question we introduce the notion of 
finite population evolutionary stable strategy (Schaffer, 1988, 1989). A finite population 
evolutionary stable strategy is the finite population analogue of a neutrally stable strategy 
(NSS). Different from "standard" evolutionary game theory, it is assumed that the entire 
(finite) population plays together in the same game. 

Definition 8 (fESS) An action x* e X is a finite population evolutionary stable strat- 
egy (fESS) of the game (X, ir) if 

n(x*, x) > ir(x, x*) for all x G X. (4) 
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In terms of the associated relative payoff game, inequality Q is equivalent to 

A(x*,x) > for all x E X. 

Already Schaffer (1988, 1989) observed the relationship between fESS and Nash equi- 
librium of the relative payoff game. 

Proposition 2 (Schaffer, 1988, 1989) Let (X, A) be the relative payoff game derived 
from the symmetric game (X, tt) by setting A(x, y) = ir(x, y) — ir(y, x) . Then the following 
statements are equivalent: 

(i) x* is a fESS of(X,ir), 

(ii) x* is a pure saddle point action of (X, A). 

Proof, x* is a symmetric Nash equilibrium action of (X, A) if 

A(x*,x*) > A(x,x*) for all x e X. 
By symmetry of payoffs and the zero-sum property, 

A(x,x*) = -A(x*,x). 
Hence, the inequality is equivalent to 

A(x*,x*) + A(x*,x) > 0. 
Since A(x*,x*) = by definition, we have 

A(x*,x) > 

which is precisely the definition of fESS. 

Since (X, A) is a symmetric two-player zero-sum game, an action is a Nash equilib- 
rium action if and only if it a saddle point action. □ 

This observation is closely related to Ania (2008) and Hehenkamp, Possajennikov, and 
Guse (2010) who show for which classes of games fESS and Nash equilibrium coincide. 

Uniqueness of the fESS does not matter in the sense that all fESS are relative payoff 
equivalent. An action x is payoff equivalent to an action y if the payoff from playing x 
equals the payoff from playing y for every action of the opponent. 
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Remark 5 For every symmetric game, all fESS are relative payoff equivalent. 

Proof. This follows from Proposition [2] and the fact that pure saddle points are strong 
solutions in the sense of Nash (1951, p. 290-291). □ 

Theorem [TJ Proposition |2j and Remark [4] allow us to provide a characterization of 
symmetric two-player games who possess a fESS. 

Corollary 2 A finite symmetric game (X, 7r) has a fESS if and only if its associated 
relative payoff game (X, A) is not a generalized rock-paper-scissors matrix. 

From Corollary [TJ Proposition |2j and Remark [4] we obtain: 

Corollary 3 Every symmetric 2x2 game has a fESS. 

The next two corollaries follows from Theorem |2j Proposition [2j and Remark |4} 

Corollary 4 Let (X, A) be the relative payoff game associated with a finite symmetric 
two-player game (X,tt). If A is quasiconcave, then a fESS of(X,n) exists. 

Corollary 5 Let (W n ,Tc) be a symmetric two-player game for which tc(-, •) is concave in 
its first argument and convex in its second argument. If the players ' actions are restricted 
to a finite subset X of the finite dimensional Euclidian space M. m , then a fESS exists. 

Propositions [Tj [2j and Remark [4] imply the following corollary. 

Corollary 6 Let (X, tt) be a symmetric two-player game with X compact and it contin- 
uous, and the associated relative payoff game be (X, A) . 

(i) If X is totally ordered and A has decreasing differences on X x X , or 

(ii) if X is totally ordered and A has increasing differences on X x X , or 
(Hi) if X is totally ordered and A is a valuation, or 

(iv) if A is additively separable, or 

(v) if(X,A) is an exact potential game, 
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then (X, 7r) has a fESS. 



The following corollary provides a sufficient condition on the payoff function it of the 
underlying game (X, tt) for conditions (i) to (v) of Corollary [6] We will see in the next 
section that this condition is satisfied in many well-known textbook examples. 

Corollary 7 Consider a symmetric two-player game (X, tt) with a compact action set 
X and a payoff function that can be written as tt(x, y) = f(x) + g(y) + a(x, y) for some 
continuous functions f,g : X — > 1R and a symmetric function a : X x X — > IR (i.e., 
a(x, y) = a(y, x) for all x, y G X). Then (X, n) has a fESS. 

3.3 Examples 

Existence of fESS in Examples [2] to [9] follows from Corollaries [6] or [7j They demonstrate 
that the assumption of additively separable relative payoffs is not as restrictive as may 
be thought at a first glance. 

Example 2 (Cournot Duopoly with Linear Demand) Consider a Cournot duopoly 
given by the symmetric payoff function by tt(x, y) = x(b — x — y) — c(x) with b > 0. Since 
ir(x, y) can be written as ir(x, y) = bx — bx 2 — c(x) — xy, Corollary^ applies and a fESS 
exists. 

Example 3 (Bertrand Duopoly with Product Differentiation) Consider a differ- 
entiated duopoly with constant marginal costs, in which firms 1 and 2 set prices x and y, 
respectively. Firm Vs profit function is given by 7r(x,y) = (x — c)(a + by — \x), for a > ; 
b G [0, 1/2). Since n(x, y) can be written as 7r(x, y) = ax — ac + \cx — \x 2 — bey + bxy, 
Corollary applies and a fESS exists. 

Example 4 (Public Goods) Consider the class of symmetric public good games de- 
fined by ir(x,y) = g{x,y) — c(x) where g(x,y) is some symmetric monotone increasing 
benefit function and c(x) is an increasing cost function. Usually, it is assumed that g 
is an increasing function of the the sum of provisions, that is the sum x + y. Various 
assumptions on g have been studied in the literature such as increasing or decreasing 
returns. In any case, Corollary^ applies and a fESS exists. 

Example 5 (Common Pool Resources) Consider a common pool resource game with 
two appropriators. Each appropriator has an endowment e > that she can invest in 
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an outside activity with marginal payoff c > or into the common pool resource, x G 
X C [0,e] denotes the maximizer's investment into the common pool resource (likewise y 
denotes the imitator's investment). The return from investment into the common pool re- 
source is ■^ J (a(x+y) — b(x+y) 2 ), with a, b > 0. So the symmetric payoff function is given 
byn(x,y) = c(e — x) + ^^(a(x + y) — b(x + y) 2 ) ifx,y > and ce otherwise. (See Walker, 
Gardner, and Ostrom, 1990.) Since A(x,y) = (c(e — x) + ax — bx 2 ) — (c(e — y) + ay — by 2 ) , 
Corollary [6| implies the existence of a fESS. 

Example 6 (Minimum Effort Coordination) Consider the class of minimum effort 
games given by the symmetric payoff function ir(x,y) = min{x,y} — c(x) for some cost 
function c (see Bryant, 1983 and Van Huyck, Battalio, and Beil, 1990). Corollary^ 
implies that a fESS exists. 

Example 7 (Synergistic Relationship) Consider a synergistic relationship among two 
individuals. If both devote more effort to the relationship, then they are both better off, 
but for any given effort of the opponent, the return of the player's effort first increases 
and then decreases. The symmetric payoff function is given by ir(x,y) = x(c + y — x) 
with c > and x,y E X C IR + with X compact (see Osborne, 2004, P- 39). Corollary^ 
implies that the existence of fESS. 

Example 8 (Arms Race) Consider two countries engaged in an arms race (see e.g. 
Milgrom and Roberts, 1990, p. 1272). Each player chooses a level of arms in a compact 
totally ordered set X . The symmetric payoff function is given byii(x,y) = h(x — y)—c(x) 
where h is a concave function of the difference between both players ' level of arms, x — y, 
satisfying h(x —y) — —h(y — x). Corollary^ implies that a fESS exist. 

Example 9 (Diamond's Search) Consider two players who exert effort searching for 
a trading partner. Any trader's probability of finding another particular trader is pro- 
portional to his own effort and the effort by the other. The payoff function is given by 
ii(x,y) = axy — c(x) for a > and c increasing. (See Milgrom and Roberts, 1990, 
p. 1270.) The relative payoff game of this two-player game is additively separable. By 
Corollary [6| implies the existence of a fESS. 

Example 10 (Nash Demand Game) Consider the Nash Demand game as follows 
(see Nash, 1953)^ Two players simultaneously demand an amount in IR + . If the sum is 

3 Interestingly, early experimental evidence for relative payoff concerns were found when testing Nash 
bargaining (Nydegger and Owen, 1974). 
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within a feasible set, i.e., x + y < s for s > 0, then player 1 receives the payoff tt(x, y) = x 
if x + y < s, and n(x,y) = otherwise (and symmetrically for player 2). The relative 
payoff function is quasiconcave. If the players' demands are restricted to a finite set, then 
Corollary implies the existence of fESS. 

Example 11 (Rent Seeking) Two contestants compete for a rent v > by bidding 
x,y G X C ]R + . A player's probability of winning is proportional to her bid, and 
zero if both players bid zero. The cost of bidding equals the bid. The symmetric payoff 
function is given by 7c(x,y) = -^j^v — x (see Tullock, 1980, and Hehenkamp, Leininger, 
and Possajennikov, 2004). n(x,y) is concave in x and convex in y. Thus Corollary^ 
implies that a fESS exists. 

Example 12 Consider a symmetric two-player game with the payoff function given by 
ir(x,y) = | with x,y G X C [1,2] with X being finite. This game's relative payoff 
function is quasiconcave. Corollary^ implies the existence of fESS of (X, n). Moreover, 
the example demonstrates that not every quasiconcave relative payoff function is additively 
separable. 

The following example shows that the pure saddle point of the relative payoff game 
and the fESS of the original game may not necessary coincide with Nash equilibrium 
of the underlying gamej^] Moreover, it shows that extremely inefficient outcome may be 
selected by fESS. 

Example 13 Consider the symmetric 2x2 game given in the following payoff matrix: 

A B 
A ( 4,4 1,2 \ 
B \ 2,1 0,0 J 

This game has a unique Nash equilibrium, (A, A), that is efficient and in strictly dominant 
actions. Yet, the unique fESS is (B,B). 
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